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Abstract 

A new approach for the approximation of the channel log-HkeHhood ratio (LLR) for wireless channels based 
on Taylor series is proposed. The approximation is applied to the uncorrelated flat Rayleigh fading channel with 
unknown channel state information at the receiver. It is shown that the proposed approximation greatly simplifies 
the calculation of channel LLRs, and yet provides results almost identical to those based on the exact calculation of 
channel LLRs. The results are obtained in the context of bit-interleaved coded modulation (BICM) schemes with 
low-density parity-check (LDPC) codes, and include threshold calculations and error rate performance of finite- 
length codes. Compared to the existing approximations, the proposed method is either significantly less complex, 
or considerably more accurate. 

A preliminary version of part of this paper was presented at IEEE Globecom 2010, Miami, Florida, Dec. 6 - 10, 2010. 
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Index Terms 

Log-likelihood ratio (LLR), LLR approximation, wireless channels, flat fading, Rayleigh fading, uncorrected 
Rayliegh fading, bit-interleaved coded modulation (BICM), low-density parity-check (LDPC) codes, iterative de- 
coding, decoding threshold, SNR threshold. 

I. INTRODUCTION 

In binary transmission over a wireless channel, the derivation of channel log-likelihood ratios (LLR) 
is often needed at the receiver for the detection and/or decoding of information. The channel LLR 
is sometimes referred to as soft information, and its availability can improve the performance of the 
detection/decoding schemes significantly. The channel LLR values depend on the channel output, the 
noise power and the fading characteristics as well as the amount of channel state information (CSI) 
available at the receiver. In practical systems, however, acquiring the CSI would require extra bandwidth 
for the transmission of pilot symbols and extra complexity at the receiver for the channel estimation. In 
certain scenarios, this may not be desirable. It is thus important to derive the LLR at the absence of CSI. 
In particular, low-complexity approximations of LLR are of great practical importance. One should note 
that even if efforts are made to estimate the channel and to attain the CSI, there always exist errors in the 
estimation process, which in turn results in imperfect CSI at the receiver. There has been thus literature 
on the study of the effect of imperfect CSI on the performance of transmission schemes (see, e.g., [11]), 
and on the design of schemes which are robust to such imperfections (see, e.g., ESI). 

At the absence of CSI at the receiver, the relationship between the channel LLR, L, on one hand, and the 
channel output Y , and the noise power a^, on the other hand, is complex. This can significantly increase 
the complexity of a detection/decoding process which relies on the calculation of channel LLR values. 
In addition, the complex relationship cr^), can impede the analysis and the design of transmission 
schemes over wireless channels which depend on the calculation of the probability density function (pdf) 
of L as the starting point. One example is the application of density evolution [9| to the analysis and 
the design of coded schemes. Motivated by these, much research has been devoted to the approximations 
of channel LLR values for wireless channels; see, e.g., [|6l, [fT3]| . [fT4ll . IfTSlI and the references therein. 
In particular, linear or piece-wise linear approximations of L as a function of Y have received special 
attention due to their utmost simplicity. 

To analyze and design binary low-density parity-check (LDPC) codes for binary phase shift keying 
(BPSK) transmission over flat Rayleigh fading channels in the absence of CSI, Hou et al. [6] proposed 
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the following linear approximation of the channel LLR: 

La = ^E{A)Y ^ aAY , (1) 

where E(A) is the expected value of the channel gain. Though very simple, this approximation is not 
very accurate and performs rather poorly compared to true LLR values lfT4]| . A more accurate linear 
approximation of LLR was recently proposed in 0141 as 

Lc = , (2) 

where 

/oo 
log^il + e-')fi{i)di}. (3) 
-oo 

In ([3]), fi(l) is the pdf of the approximate linear LLR parameterized by a according to L = oY . It is shown 
in lfT4l that the approximation in Q provides considerable improvement compared to ([1) for the BPSK 
modulation and results in performances very close to those of the true LLR calculation. The calculation 
of a^j is however, much more complex than that of ua and requires solving the convex optimization 
problem of (|3]) using numerical techniques. 

The general approach of [|T4l based on the formulation of ^ and ^ was then generalized to non-binary 
modulation schemes in ifTSl . where piece- wise linear approximations of LLR for and 16-QAM 

constellations were derived. These results were then used to evaluate the performance of LDPC-coded 
BICM schemes. It was demonstrated [I15II that for the tested LDPC codes, the gap in the performance of 
8-PAM for true LLR calculations and the approximations is rather small (a few hundredths of a dB). This 
gap however, is larger for 16-QAM (about 0.2 dB). 

In this paper, we propose to use the Taylor series of the channel LLR as the method of approximation. 
Although many of our results are in principle applicable to a variety of fading channel models, in this 
work, we only consider the uncorrected flat Rayleigh fading channel. For the BPSK transmission over 
this channel with no CSI, we derive the Taylor series analytically and demonstrate that by using only the 
first term of the series, one can obtain an analytical linear approximation which is almost as simple as 
(dl) and yet is practically as accurate as (|2]). By using the first two terms of the series, we derive a more 
accurate analytical non-linear approximation of the channel LLR and obtain performance improvements 
compared to the approximation of (|2]). 

For non-binary modulations, we derive piece-wise linear and non-linear approximations of channel 
LLRs based on the Taylor series. Compared to the piece- wise linear approximation of [fTSl . our approach 
is simpler, both conceptually and complexity-wise. Moreover, our approach can be easily extended from 
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piece-wise linear to non-linear approximations. This however, may not be simply achievable for the 
approach of [[T5|. where the linearity has an important consequence of making the optimization problem 
convex and thus tractable. Performance- wise, we demonstrate that for the 8-PAM constellation in an LDPC- 
coded BICM scheme, our piece-wise linear approximation performs as good as the approximation of [031 
and very close to true LLR calculations. We expect this to be the case also for other one-dimensional 
constellations. For two-dimensional constellations such as 16-QAM however, our second order Taylor 
series approximation of LLR outperforms the approximation of [|T5l handily, and still performs very close 
to true LLR calculations. 

It is important to note that the complexity of calculating the approximate LLR is particularly important 
for two-dimensional constellations. While one might argue that such computations can be performed off- 
line and the results can be stored at look-up tables for different values of noise power and received signal 
values, such tables will have to be three dimensional for two-dimensional constellations, thus requiring 
much larger storage. If storage is constrained, one may have to perform the calculations on-line. Another 
point worth emphasizing is the importance of the computational complexity of finding the pdf of the LLR 
(or its approximations) in the process of analyzing or designing a transmission scheme using techniques 
such as density evolution [9]. These techniques, which are used for iterative coding/processing schemes 
(also known as message-passing schemes), are based on tracking the pdf of messages throughout iterations, 
starting from the pdf of the channel LLR. This is usually performed multiple times for different values 
of the channel signal-to-noise ratio (SNR) to find the infimum value of SNR for which the algorithm 
succeeds (probability of error tends to zero as the number of iterations tends to infinity). This infimum 
value of the channel SNR is called the threshold. One example of such analysis, is to find the threshold 
of an ensemble of LDPC codes B9l|. One thus needs to find the pdf of the channel LLR many times 
for different SNR values in this process. The number of times such computations have to be repeated 
increases even further (by a significant margin) in a design process. Such a process is usually based on 
iteratively optimizing different variables to achieve the best performance. For example, in the design of 
irregular LDPC code ensembles, degree distributions of variable nodes and check nodes are optimized to 
achieve the best threshold [fTOl . This design process usually includes an analysis loop which is repeated 
numerous times as the design variables are modified to converge to a local optimum. 

The remainder of the paper is organized as follows: Section lUis devoted to the fading channel model, 
LDPC codes, BICM scheme and the derivation of channel LLRs. In Section [nil we present the Taylor 
series approximations of the channel LLR for uncorrelated flat Rayleigh fading channels. Simulation 
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results are presented in Section |IVJ and finally Section |V] concludes the paper. 

II. CHANNEL MODEL, BICM SCHEME, AND LDPC CODES 

A. Channel Model, BICM and LLR Approximations 
Consider the following model of a flat fading channel: 

Yt = AXt + Zt, (4) 

where Xt and Yt represent the channel input and output at time t, respectively; Zt is the zero-mean (possibly 
complex) Gaussian noise with variance cr^ (2(T^ for two-dimensional constellations), and > is the 
channel gain, both at time t. In this work, we assume that At has a normalized Rayleigh distribution, i.e., 
PAt{ct) = 2a e~"^, where PAt{o) is the pdf of At. We further assume that sequences {Xt}, {At} and {Zt} 
consist of independent and identically distributed (i.i.d) random variables. Moreover the three sequences 
are assumed to be independent of each other. This model is referred to as the uncorrelated flat Rayleigh 
fading channel. 

At the transmitter, the information bit sequence is first mapped to the coded bit sequence by being 
passed through the LDPC encoder. The coded bit sequence is then partitioned into blocks of length m. 
Each block = {6^, bl, . . . , 6™} is then mapped to a signal X^, A; = 1, . . . , M, from a Gray-labeled 
M-ary signal constellation x with M = 2*" signals. The block b^. is referred to as the kth symbol 
corresponding to the kth signal, and b\ is the ith bit of the kth symbol (signal). Between the encoder and 
the modulator, an interleaver conventionally exists. This however may not be required for the LDPC codes, 
as the interleaver is inherent in the structure of these codes when the parity-check matrix is constructed 
randomly Q^. For M > 2, this setting is also known as bit-interleaved coded modulation (BICM). In 
this work, we assume ideal interleaving of the bits, which implies that the transmission of each symbol 
over the channel is equivalent to the transmission of its constituent bits over m parallel and independent 
memoryless binary-input channels. These channels are referred to as bit-channels. At the receiver, the 
LLR for each bit-channel is independently calculated. 

In the channel model described above, assuming that the noise variance is known at the receiver, we 
will have two scenarios depending on the availability of At at the receiver 13 

'in the rest of the paper, the time index t may be dropped since the distribution of random variables does not depend on t. Also, upper 
case and lower case variables are used to denote random variables and their values, respectively, e.g., random variable Y can take the value 

y- 
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1) Known CSI: In this case, the channel gain At is known at the receiver for every t. Thus the channel 
LLR of the ith bit, corresponding to the output y and the channel gain a, is given by 

'°%fe|6'W = l,a) ""^E^aiflfl^.") 
where lf{x),i E {1, . . . , m}, is the ith bit of the signal x, Xw is the subset of the signals x in x where 
b^x) = w, w e {0,1}, and the conditional pdfs are given by p{y\x,a) = exp(— ), for 
two-dimensional signal constellations, or by exp ( — ^^^^i ^ ) for one-dimensional constellations. 
For the case of BPSK modulation, the above formulation simplifies to: 

l = -,V. (6) 

2) Unknown CSI: In this case, the channel gain At is unavailable at the receiver. The channel LLR for 
the ith bit can then be calculated as 

p{y\t{x) = l) ExexlP(^l^) 
where p{y\x) = /o°° 2^ 6xp(— ) pA{ci)da, for two-dimensional constellations, or p{y\x) = 

--^=- exp(— )pA{a)da, for one-dimensional constellations (including BPSK). 
. BPSK 

For BPSK modulation over normalized Rayleigh fading channels. Equation ^ reduces to [T4] 

where $(z) = 1 + y/nze^^eTk^—z), and erfc(.) represents the complementary error function. 
• M-ary PAM 

For the M-ary PAM signal set, the conditional pdf of the received signal, assuming a normalized 
Rayleigh fading channel with no CSI is given by 

Piy\^) = — ^r^(0ra;yerfc( — — — ) + 
y'-rra-^ 2aa 

2 2 

V2aae'^), (9) 



where a = + 2a'^. Replacing ^ in dV]), the true LLR values can be calculated. 
M-ary QAM 



7 



For the M-ary QAM constellation, assuming the normalized Rayleigh fading channel with no CSI 
at the receiver, we have the following conditional pdf of the received complex value y = Vr+jVi 
given that the symbol x = Xr + jxi is transmitted: 



where 7^ = x^yf + xjyl + 2(T^(y^ + yf) and a = a/x^ + x- + 2cr2. 
True LLR values are then calculated using (|7]) and (flOl ). 

In this paper, our main focus is on Case 2, where the CSI is unknown at the receiver. In this case, the 
relationship between the channel LLR(s) and the channel output, given by ([7]), is rather complex. This 
means that the calculation of channel LLR values, required at the receiver, as a function of channel outputs 
is computationally expensive. Moreover, it would be very challenging to obtain the pdf of the channel LLR 
using (|7]). This pdf would be helpful to analyze the performance of different detection/decoding algorithms 
or to design one. In [[61 , the linear approximation of ([T]) was proposed to simplify the relationship between 
L and Y for the BPSK modulation. This approximation however has proved to be rather inaccurate 
resulting in performance degradations of a few tenths of a dB compared to true LLR calculations [fT4l . 
Recently, the more accurate linear approximation of dD was proposed in [fT4l . This approximation was 
shown in [[T4| to perform well with binary LDPC codes and the BPSK modulation, and to result in rather 
large performance improvements compared to the approximation of ([T])- The downside however is the 
complicated relationship between a^^ and cr^, and the relatively high computational complexity of solving 
([3]). The approach of [fT4l was then generalized in [15] to non-binary constellations, where piece- wise 
linear approximations of LLR were devised. These approximations performed very closely to true LLR 
calculations for an LDPC-coded BICM scheme based on the 8-PAM constellation, but relatively poorly 
for the 16-QAM constellation (a gap of about 0.2 dB to the true LLR calculations). 

It is important to note that other approximations of the channel LLR for fading channels are given 
in the literature. For example, in [fT3l , the log-sum approximation log^^/3fc ^ maxjtlog/3fc was used to 
approximate © as a piece-wise linear function. The approximation however is only good in the high 
SNR regime, where the sum is dominated by a single large term. Moreover, in the absence of CSI, which 
is of interest in this paper, the approximation does not lead to a piece-wise linear function and is much 
more complicated to implement. 

Also noteworthy is that the LLR approximation ([T]) of [l6^ for BPSK with unknown CSI can be interpreted 



P[y\x) = —={yrXr + yiXi)e erfc( 




2aa 



(10) 
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as the minimum mean square error (MMSE) estimation of (|6), the BPSK LLR for known CSI, given the 
received value y. The idea of using the MMSE estimate of LLR for known CSI as the approximate LLR 
in the absence of CSI can also be applied to non-binary modulations. Our study however shows that the 
performance degradation compared to true LLR calculations is rather large, e.g., about 0.5 dB for both 
8-PAM and 16-QAM. 

B. LDPC Coding 

We consider the application of binary LDPC codes for the transmission of information over the 
binary-input uncorrelated flat Rayleigh fading channel described in Subsection III-AI This channel is 
memoryless. It is also output- symmetric [9] when BPSK modulation is used for the transmission. It 
is however known that when M > 2, the m bit-channels associated with the BICM scheme are not 
necessarily output-symmetric [71. To simplify the analysis, we thus use the technique of augmenting the 
bit-channels with i.i.d. channel adapters as in Q. This makes the resulting channels output- symmetric. 
We also consider symmetric message-passing decoders [HI such that the conditional error probability 
is independent of the transmitted codeword [|9l. For simplicity, therefore, we assume that the all-zero 
codeword is transmitted. This will be particularly helpful for density evolution, where the pdf of LLR 
values and their approximations is needed under this assumption. 

The error rate performance of the transmission schemes is measured as a function of the channel signal- 
to-noise ratio (SNR), given by E^/Nq for BPSK, and Es/Nq for non-binary modulations, where Ei, and 
Eg are the average energy per information bit and per transmitted symbol, respectively, and Nq is the 
one-sided power spectral density of the additive white Gaussian noise (AWGN). For BPSK, assuming 
X = ±1 is transmitted, the SNR is related to the noise variance by E^/Nq = l/(2i?cr^), where R is the 
rate of the LDPC code. For 8-PAM and 16-QAM, given in Fig. [B the SNR is given by 21/ {2a'^), and 
10/(2cr^), respectively. 

To investigate the performance of transmission schemes, we use Monte-Carlo simulations at finite block 
lengths, and density evolution for asymptotic analysis. In the latter case, the threshold [j^, [0, [[7] of the 
transmission scheme for LDPC code ensembles is calculated as the measure of performance. For more 
information on LDPC codes and the calculation of the threshold, the reader is referred to [0, [[6], [Q. 
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III. LLR APPROXIMATION BASED ON TAYLOR SERIES 

A. Brief review of Taylor series 

In this subsection, we provide the definition of one- and two-dimensional Taylor series (polynomials), 
which we subsequently use for the LLR approximation of one-dimensional and two-dimensional signal 
constellations, respectively. 

Definition 1. Suppose that f{x) has n derivatives at a point xq G [a, h]. The one-dimensional Taylor 
polynomial of order n for f{x) at point Xq is then defined by 

Pn{x) = /(Xo) + /'(xo)(x - X,) + ^-^{X - Xof + • • • + ^^^^{x - XoT 

-E^(-^-o)^ (11) 

k=0 

Definition 2. Suppose that f{x, y) has up to nth partial derivatives at a point (xq, yo) on a convex subset 
VL o/M^. The two-dimensional Taylor polynomial of order n for f{x,y) at (xo,?/o) is then defined by 

P^i-.V) = E E|^(^°'^") 7°'' 'J°'"' taa„y(..,)ea (12) 

£+m<n 

The difference between the true value of the function and its Taylor polynomial approximation is called 
the remainder. There are different forms to represent the remainder. The most commonly used is the 
Lagrange form, where the reminder in the case of one- and two-dimensional Taylor series, is given by flU 

i^(.-.or«. (13) 

and 

(x - xqY {y - yor 

e+m=n+l 

respectively, where c is a number between xq and x, and (xi, yi) is a point on the line connecting (xq, yo) 
and (x, y). For the one-dimensional case, this requires f^^\ f^'^\ . . . , /("^ to be continuous on [a, b], and that 
to exist in (a, b) [21. For the two-dimensional case, to have ([14]) as the remainder, the requirement 
is that / must have continuous partial derivatives of order n + 1 in a neighborhood of every point on a 
line segment joining two points (xo,2/o) and (x, y) in il [O. More details on the convergence properties 
of Taylor series can be found in [|2l, flU, 



10 



B. LLR approximations 

Our goal in this part of the paper is to approximate the LLR for one- and two-dimensional signal 
constellations as a function of the channel output, using Taylor polynomials of different orders. For the 
channel model considered here, the LLR is a differentiable function of the channel output and thus lends 
itself well to the Taylor series approximation. We are interested in using polynomials of smallest order 
as long as the approximation is accurate enough for the application under consideration. In particular, 
linear approximations are of most interest followed by second, third and larger order approximations. To 
obtain a sufficiently accurate approximation over a wide range of channel outputs and for a relatively low 
complexity, it is sometimes beneficial to use piece-wise approximations, where the domain of interest is 
partitioned into sub-domains. In each sub-domain then, a different approximation will be used. While it 
is possible to approximate the LLR within a given domain of interest with an arbitrarily high accuracy, if 
one has no constraints on the number of sub-domains and the order of approximations; in practice, due 
to the limited computational resources, the number of sub-domains and the order of approximations need 
to be small. 

In addition to the selection of the number and the boundaries of the sub-domains, and the order of 
approximation in each sub-domain, one also needs to choose the point within each sub-domain at which 
the Taylor series is derived. This in general, could be a complicated optimization problem, defeating the 
whole purpose of finding low-complexity approximations for LLR. In this work, we limit ourselves to 
(piece-wise) linear, second and third order approximations. Since the accuracy of the LLR is particularly 
important for smaller LLR values, where a small error can change the sign of the LLR and thus the 
corresponding hard-decision, we select the roots of the LLR as the points around which the Taylor series 
is derived. The number and boundaries of the sub-domains will then be identified based on the number 
of roots, and the general shape of the LLR function. This will be explained in more details for BPSK, 
8-R\M and 16-QAM in the following^ In particular, the simplicity of BPSK modulation makes it possible 
to derive closed-form analytical expressions for the Taylor approximations for any value of the channel 
SNR. 

1 ) BPSK Modulation: The uncorrected flat Rayleigh fading channel with BPSK modulation is output- 
symmetric. For an output-symmetric channel, LLR is an odd function of the channel output [fT4l . i.e., if 
L = g{Y), then g{—y) = —g{y), Vy. It is thus natural to look for approximations which maintain the 
same odd symmetry. Both linear approximations ([T) and (|2]) are odd symmetric. From ([8]), it is easy to 

^BPSK, 8-PAM and 16-PSK are all used in I14II . and 1151 . We thus use the same constellations for comparison. 
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see that for the channel under consideration, the LLR is a continuous and differentiable function of the 
channel output with only a single root at y = 0. In fact, the Taylor series of ([8]) in the neighborhood of 
y = is given by 



2rr y ^ V2n{n - 3) ^y ^ 



- + rn , o .wJ -r + Q(r)- (15) 



l + 2a2 a 6(1 + 2(t2)3/2v^' 
Corresponding to (fTST ). we propose the following linear approximation of the channel LLR: 



Llt = \l = ^tY , (16) 



and the non-linear approximation given by 



Note that for small channel SNR values where 2a'^ >> 1, the approximation (fT6] ) reduces to ([1). 

In Fig. [2l true LLR values from ([8]) are compared with the proposed approximations (fT6l) and (fTTT ) for 
cr = 0.6449. As expected, the approximations are very accurate for smaller values of y, with the non-linear 
approximation being more accurate and almost identical to the true LLR values for \y\ < 4. 

To apply density evolution to iterative algorithms with the approximated channel LLR values, we need 
to derive the pdf of Lit and Lnt given in (fT6l) and (flTI) . respectively, assuming X = +1 is transmitted. 
From dS]), we have 

p{y\ + l,a) = ^exp(-^^-l|l^) . (18) 
^/ lira ^ cr 



Averaging (|T8l ) over the distribution of A, we obtain 



+ 1) = V^27l^exp( ^)9(^ ^ ), (19) 

where 6(2;) = e~^^ + ^¥-2^ erfc(— -z)- Based on (fT6l) . the pdf of Llt, given that X = +1 is transmitted, 
is derived as: 

Vt M(0 = ^^fexp(-il±^)+ (20) 

If , ^2 /2 / 

-/ exp ( ) erfc(- 



2 271 ' ' 20F 

The pdf of I/ATT is calculated using (fT9l) . and based on the relationship (fTTl) between Latt and Y as 
follows: 

+ 1 



\9'iy)\ 



(21) 



y=9-Hi) 
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where g{y) = axy + PtU with the derivative g'iy) = + 3/3^2/ , and the inverse 
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in which 0(0 = ^12 /3|(9/ + + 81 P). 

2) 8-PAM: Consider the 8-PAM signal set with Gray labeling as shown in Fig. \T\ True LLR values 
for the three bits can be calculated using © and (|9]). These values clearly depend on the value of the 
channel SNR. We now explain the Taylor approximation of the three LLRs based on a given value of 
SNR= 7.91 dB. In Fig. H for SNR= 7.91 dB, the true LLR values are plotted with full lines as a function 
of the channel output y. As expected, all three functions are symmetric with respect to the vertical axis at 
y = 0. The LLR of the first bit, has a single root at y = 0. The roots of /^^^ and l^^^ are respectively 
{-3.3449, 3.3449} and {-6.9832, -1.8848, 1.8848, 6.9832}. We thus partition the domain of y values to 
one, two and four sub-domains, for the three LLRs, respectively. 

Suppose that the kth derivative of the LLR function of the ith bit is denoted by f-'^K For the first bit, a 
linear approximation of the LLR can be obtained by the first order Taylor polynomial at y = as follows: 

L«=/f)(0)r. (23) 

Due to the symmetry of the LLR functions, we have 

fr-%)=-fr''\-y), 

f?'\y) = f?'\-y), (24) 

for integers k > 1. We thus have the following piece-wise linear approximations based on Taylor series 
for the second and the third bits, respectively: 

L^'^ = A'\yi)iY - y^)IiY > 0) - fi'\yi)iY + y{)I{Y < 0) = A'\yr)\Y\ - f^'\yr)y, , (25) 

L^'^ = if\y2){Y - y2)I{c <Y) + if\y,){Y - y^)I{Q <Y<c) 
- f?{y,){Y + y,)I{-c < r < 0) - f?{y2){Y + y2)I{Y < -c) 

= {f^^\y2)\Y\ - fi'\y2)y2) I{c <\Y\)+ {fi'\ys)\Y\ - f^'\ys)ys) I{\Y\ < c) . (26) 

where /(.) is the indicator function, yi = 3.3449, y2 = 6.9832, y^ = 1.8848, and c = 3.7266 is the y 
value of the point where the two linear approximations for the LLR function of the third bit intersect in 
the y > region (see Fig. l3c] ). 
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In Table m the coefficients of the linear approximation (|23] ) and the piece- wise linear approximations (|25T ) 
and (|26l) for SNR= 7.91 dB are given in the first row. It is worth mentioning that for all three functions, 
second order derivatives at the roots of LLR functions are zero. The coefficients of the terms with degree 
3 in the Taylor polynomial are also given in the second row of the table. 

In Fig. [3l the first, and the third order Taylor polynomials for the approximation of the three LLRs 
are also plotted. Comparison with true LLRs shows that the accuracy of the approximations improve 
consistently by increasing the order of the polynomials. 

3) 16-QAM: Consider the 16-QAM constellation with Gray labeling as shown in Fig. \T\ True LLR 
values for the four bits can be calculated using (|7]) and (fTOl ). These values clearly depend on the value 
of the channel SNR. We now explain the Taylor approximation of the four LLRs based on the value of 
SNR= 4.89 dB. 

Since 16-QAM is two-dimensional, we need to use two-dimensional Taylor polynomials for the ap- 
proximation of LLRs, where each LLR is a function of the channel output y = Ur + jVi- One difference 
compared to the one-dimensional cases is that, the roots of the LLR functions in the two-dimensional 
case are located on one or more two-dimensional curves rather than belonging to a discrete set of values. 
To derive the Taylor polynomial in a sub-domain, a single point from such a curve within the sub-domain 
should then be selected so that the Taylor coefficients can be computed at that point. The selection of such 
a point depends on the general shape and symmetries of the LLR function, as explained in the following. 

In Figures |5ta) and (b), the contours of fixed (true) LLR values for the first and the second bit of 
the constellation are shown in the (y,., yi) plane, respectively. As can be seen, for the first bit, the curve 
corresponding to l^^^ = is = 0. For the second bit, there are two curves, symmetric with respect 
to yr = corresponding to l^"^^ = 0. The existing symmetries in the LLR functions with respect to both 
yr = and yi = suggest the selection of (0, 0), and 0) and 0), as the points around which the 
Taylor approximations of l^^^ and should be derived, respectively, where ^ = 1.8908 is the intersection 
of the curve corresponding to /^^^ = with the line yi = in the region yr > of the {yr,yi) plane. 

The corresponding Taylor polynomials of the third and the second order for L^^^ and L^'^\ are respec- 
tively derived as: 

L(i) = -0.9878 Yr - 0.04285 Y^ - 0.01654 Y^ , (27) 

= _ 0.9285 + 0.2690 \Yr\ + 0.1174 F^^ - 0.0364^.2 . (28) 

Based on the symmetry in the Gray labeling of 16-QAM, the LLR values for the third and the fourth bits 
are similar to those of the first and the second bits, respectively, except that the real and the imaginary 
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parts of y need to be switched. We thus have the following Taylor approximations for L^'^^ and L^-^\ 
respectively: 

= 0.9878 + 0.04285 Yi + 0.01654 , (29) 
L(^) = - 0.9285 + 0.2690 \Yi\ + 0.1174 - 0.0364 . (30) 

IV. NUMERICAL RESULTS AND DISCUSSION 

In this paper, we mainly compare our results with those of [fT4l and [fTSl . which are the best known 
approximations of the channel LLR for uncorrelated flat Rayleigh fading channels in terms of performance. 
Similar to [El and [|15l, we consider the three modulations BPSK, 8-R\M and 16-QAM. Our resuhs 
however, can be easily extended to other linear modulations. 

To obtain the coefficients of Taylor approximations, we resort to the asymptotic analysis of density 
evolution with the SNR threshold as the performance criterion. The goal is then to find sufficiently accurate 
Taylor approximations for the LLR functions so that the resulting threshold of the BICM scheme is close 
to the threshold obtained using the true LLR values. As the Taylor coefficients are functions of the channel 
SNR, one approach would be to start from an SNR value above the threshold, and find the corresponding 
Taylor coefficients. Then find the threshold corresponding to the resulting Taylor approximation. (This 
threshold will be smaller than the starting SNR.) Use the new SNR threshold and find the corresponding 
Taylor approximation. Use this new approximation to find the next threshold. Continue this process until 
it converges to a fixed point, i.e., the Taylor coefficients and the SNR threshold remain unchanged in two 
successive iterations. A simpler approach, with slightly inferior results, is to find the SNR threshold using 
the true LLR values and then use that value of SNR to find the Taylor coefficients. 

A. BPSK 

In this part, we present analysis and design results based on the proposed linear and non-linear LLR 
approximations for the BPSK modulation through a number of examples. 

Example 1. In this example, decoding threshold^ of two regular ensembles of LDPC codes based on 
different LLR approximations over the uncorrelated fiat Rayleigh fading channel are calculated. The 
ensembles have the following degree distributions: Ai(x) = x^, pi{x) = x^; \2{x) = x^, p2{x) = 

^The thresholds are given in terms of Eb/No. 
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x^^^ The results corresponding to the two ensembles are given in Tables 121 and |^ respectively. These 
results indicate that while there is a large performance gap between the linear approximations ([7]) and 
([2]), the performance of the proposed linear approximation f fi^ is practically identical to that of (121). 
Unlike (12^, however, the computational complexity of (H]) is relatively high. Also noteworthy is the fact 
that the proposed approximation is analytical while the approximation ([2]) of / f7?l / must be obtained 
numerically. In both tables, the results of optimal linear approximation (Lopt = «opt^ jJfl and the non- 
linear approximation of 4771) are also given. The results show that both linear approximations perform 
practically optimally for these codes. Our proposed non-linear approximation performs the same as the 
optimal linear approximation and does not provide any further improvement. 

Example 2. In this example, decoding thresholds for two irregular LDPC code ensembles are calculated. 
The first ensemble has rate 1/2 and is optimized for a normalized Rayleigh fading channel with known 
CSI (first code in Table I of [6]). Using approximations ([T]) and (|2]), the Ei,/Nq threshold for unknown 
CSI is 3.74 dB and 2.98 dB, respectively. For the proposed linear and non-linear approximations, the 
thresholds are 2.98 dB and 2.97 dB, respectively. 

The second ensemble is a rate-1/2 threshold optimized ensemble for normalized Rayleigh fading channel 
with unknown CSI with approximation (|2]) ( Code 2 of IU4\l ). Again, for this ensemble, both (|2]) and the 
proposed linear approximation have the same threshold of 2.76 dB. The threshold for the proposed non- 
linear approximation however is improved to 2.73 dB. 

To compare the error rate performance of the proposed linear approximation and that of [fT4l at 
finite block lengths, we have tested a number of regular and irregular LDPC codes. For all cases, the 
two approximations performed practically the same, and very close to the performance with true LLR 
calculations. One such example can be found in yj. 

Example 3. In this example, we construct irregular LDPC code ensembles optimized for uncorrelated 
flat Rayleigh fading channels with unknown CSI based on the proposed non-linear approximation 4771) . 
To fairly compare our results with those of /[74j/, we choose the exact same constituent degrees as those 
in similar examples of 1^14^ . given in Table III of ^T4^ . We design two ensembles, one over a channel with 
a = 0.7436 where we maximize the rate, and the other with the flxed rate of 1/2 where we optimize the 

''The threshold results presented in this paper are obtained for an 11 -bit iterative belief propagation decoder ||9] with the maximum number 

of iterations 1000. The target probability of error for variable node to check node message error rate is set at 10~^. The maximum LLR is 

chosen to be 25 except for simulations related to non-linear Taylor approximation, for which the maximum LLR of 35 is used. 
^aopt is obtained by exhaustive search using density evolution. 
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threshold. Similar to the nomenclature used in / f74l/ . these ensembles are labeled as "Code 1 " and "Code 
2," respectively. The degree distributions for the two ensembles are given in Table Code 1 has a rate 
0/0.4941 compared to 0.4937 of the similar code in fT4^. The threshold of Code 2 is 2.68 dB which is 
0.08 dB better than the similar result of [14]. 

B. 8-PAM 

Similar to [jTS), in this part, we consider a BICM scheme with Gray labeled 8-PAM signal set, as shown 
in Fig.[TJ along with a (3, 4)-regular LDPC code ((A(x) = x^, p{x) = x^)). The decoding threshold for this 
scheme using true LLR values is 7.85 dB. Using this value of SNR and by following the general piece-wise 
linear approximation described in Subsection IIII-B21 we then obtain the required Taylor coefficients. Using 
this LLR approximation, the decoding threshold is degraded to 7.92 dB. If we update the coefficients of 
the approximation based on SNR= 7.92 dB, the new threshold will be 7.91 dB. The next set of Taylor 
coefficients, obtained based on SNR= 7.91 dB, however, do not change the threshold. This SNR value 
(7.91 dB) is what we used in Subsection IIII-B2I to derive the Taylor approximations for the LLR functions 
of 8-PAM. We refer the reader to Subsection IIII-B2l for the details of the Taylor approximations. 

The decoding threshold of the BICM scheme using the first and the third order Taylor polynomials are 
7.91 dB and 7.86 dB, respectively. This can be compared to the threshold obtained using the true LLRs, 
7.85 dB, and the one obtained in [[H, 7.88 dB. 

To evaluate the finite length performance of the BICM scheme, we randomly construct a (3, 4)-regular 
LDPC code of length 12,000 and girth 6. The bit error rate (BER) performance of this code with the 
8-PAM constellation over the uncorrelated flat Rayleigh fading channel is shown in Fig. |4] for both the 
first and the third order Taylor approximations. Belief propagation is used for the decoding of the LDPC 
code with the maximum number of iterations 100. In Fig. IH we have also included the BER performance 
of the same scheme with true LLR values, and the piece-wise linear approximation of [[TSl for LLRs. It is 
seen that the BER performance of our piece-wise linear approximation is similar to the piece-wise linear 
approximation of [|T5l , and almost identical to the performance of the more complex true LLRs. This is 
while the derivation of our approximation is much simpler than that of [fTSll . It can be seen in Fig. |4] 
that no practically significant gain in performance is obtained by going from first order to the third order 
Taylor approximation. This however, is not the case for 16-QAM, as demonstrated in the next subsection. 
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C. 16-QAM 

In this part, similar to [fTSl . we consider the 16-QAM signal set with Gray labeling shown in Fig. [H 
and a (3, 4)-regular LDPC code in the BICM scheme. To obtain the Taylor approximations, we use the 
general approach described in Subsection IIII-B3I A Piece-wise linear approximation results in about 0.2 
dB degradation compared to true LLR values, as also observed in [15]. We thus consider higher order 
Taylor polynomials. The BICM scheme has an SNR threshold of 4.83 dB with true LLR values. Based on 
this SNR value, we then obtain the Taylor coefficients of the third order approximations for bits one and 
three and the second order approximations for bits two and four. These approximations are then used to 
find the new threshold of the scheme. Repeating this process, we finally converge to the approximations 
given in (|27])-(|30l) for the four LLRs and the SNR threshold of 4.89 dB which is very close to that of 
true LLRs, 4.83 dB. If we consider the third order Taylor polynomial (instead of the second order) for 
the second and forth bits, the threshold improves slightly to 4.87 dB. Note that this provides 0.15 dB 
improvement over the 5.02 dB threshold obtained by the piece-wise linear approximation of ifTSl for this 
scheme. This is while the derivation of the proposed approximation is also simpler than that of [fTSl . 

Finite block length BER performance of the BICM scheme using the Taylor approximations for the 
LLRs is shown in Fig.lH The results are for a randomly constructed regular (3, 4)-LDPC code with length 
12000 and girth 6. The decoding algorithm is belief propagation with maximum number of iterations 100. 
For comparison, BER curves for the true LLR values, and the piece-wise linear approximation of are 
also given in the figure. As can be seen, the proposed Taylor approximation performs almost the same 
as true LLRs, and outperforms the approximation of [1151 by about 0.2 dB. This is while the complexity 
of computing the Taylor approximations is much less compared to both the true LLR calculation and the 
piece- wise linear approximation of [[T5l . 

Although the results reported in this paper are obtained for a fading channel with known channel SNR 
at the receiver, they can also be applied to the case where such information is unavailable at the receiver. In 
such a case, if the coding scheme is given and has a threshold a* with the proposed Taylor approximation, 
one would use the proposed approximate LLR values by substituting a* in the corresponding Taylor 
approximation. On the other hand, if one is interested in the design of a coding scheme, such as an 
irregular ensemble of LDPC codes of a given rate, over a channel with unknown a based on the proposed 
approximations, one can perform the design, assuming that a is known, to optimize the threshold. If the 
threshold value is a*, one should then use the LLR approximation by substituting a with a* . 
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V. CONCLUSION 

In communication systems, the receiver often requires to calculate the channel LLR for the processing 
of the received signal. Over wireless channels, this will have to be performed almost always at the absence 
of the full knowledge of CSI. Under such conditions, the calculation of true LLR values is computationally 
expensive. Approximations of LLR, are thus important to find. In this paper, we proposed simple (piece- 
wise) linear and non-linear approximations of channel LLR based on Taylor Series. For the uncorrected 
flat Rayleigh fading channel using one-dimensional linear modulations in the context of LDPC-coded 
BICM schemes, the proposed (piece-wise) linear approximations perform practically the same as the 
best known (piece-wise) linear approximations of [fT4l and [[T5l and very close to the performance of a 
scheme using true LLR values. This is while the derivation of the proposed Taylor approximations for the 
LLR is simpler than the computation of the approximations in [14J and ifTSl . and significantly simpler 
than the calculation of true LLR values. For two-dimensional constellations, where the piece- wise linear 
approximation of [15] causes non-negligible performance loss compared to the true LLR calculations, our 
proposed Taylor approximations still perform very close to true LLR calculations with significantly lower 
complexity. 
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TABLE I: COEFFICIENTS OF TAYLOR POLYNOMIALS FOR THE LLR APPROXIMATIONS OF 8-PAM 





Bit 1 


Bit 2 


Bit 3 


Degree- 1 coef. 


(0) = L2135 


/a'^' (3.3449) = -0.6147 


/i^' (6.9832) = -0.3419, /^^^ (1.8848) = 0.6046 


Degree-3 coef. 


/f (0) = 0.1420 


/f' (3.3449) = 0.0039 


(6.9832) = -0.0070, /f (1.8848) = -0.2920 



TABLE IL THRESHOLDS FOR THE LDPC ENSEMBLE WITH Ai(a;) = a;^, pi{x) = UNDER BELIEF 
PROPAGATION WITH DIFFERENT LLR APPROXIMATIONS 





OA = 4.514 


= 2.957 


ut = 2.874 


Uopt = 2.957 


Nonlinear Taylor 




0.6266 


0.6449 


0.6445 


0.6449 


0.6449 


^' (dB) 


4.06 


3.81 


3.82 


3.81 


3.81 



TABLE IIL THRESHOLDS FOR THE LDPC ENSEMBLE WITH A2(a;) = , p2{x) = UNDER BELIEF 
PROPAGATION WITH DIFFERENT LLR APPROXIMATIONS 





aA = 15.616 


a^j = 6.302 


UT = 6.054 


Uopt = 6.287 


Nonlinear Taylor 




0.3369 


0.3677 


0.3674 


0.3677 


0.3677 


(dB) 


7.69 


6.93 


6.94 


6.93 


6.93 
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Fig. 1: 8-PAM and 16-QAM constellations with Gray labeling 
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TABLE IV: LDPC CODES DESIGNED FOR THE UNCORRELATED FLAT RAYLEIGH FADING CHANNEL WITH 
UNKNOWN CSI BASED ON APPROXIMATION QtI). CODE 1 and 2 ARE RATE- AND THRESHOLD-OPTIMIZED, 
RESPECTIVELY. 





Code 1 


Code 2 




0.20525 


0.20683 


A3 


0.21067 


0.21646 


A4 


0.00037 


0.00046 


As 




0.00075 


As 


0.00180 


0.00230 


At 


0.18140 


0.12574 


As 


0.07439 


0.13858 


Afl 


0.00248 


0.00343 


Aio 


0.00099 


0.00137 


All 


0.00059 


0.00081 


Al5 


0.00026 


0.00035 


A20 


0.00024 


0.00032 


A29 


0.00181 


0.00247 


A30 


0.31975 


0.30013 


P9 


1.0000 


1.0000 


Rate 


0.4941 


0.5000 


(7* 


0.7436 


0.7345 


Ei/Na* (dB) 


2.63 


2.68 
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Fig. 2: Comparison of true LLR values and the approximations obtained by Taylor series for the 
uncorrelated flat Rayleigh fading channel with unknown CSI and a = 0.6449. 
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Fig. 3: True bit LLR values and /(^^ as functions of the channel output y for 8-PAM at SNR=7.91 

dB, along with the corresponding (piece-wise) Taylor approximations. 
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SNR (ilB) 



Fig. 4: BER performances of BICM schemes with 8-PAM and 16-QAM in combination with a (3,4)- 
regular LDPC code of length 12000 based on various Taylor approximations of LLR, the piece-wise linear 
approximation of [|T5l . and true LLR values, over the uncorrelated flat Rayleigh fading channel. 
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(b) Contours of fixed l^^^ 

5: Contours of fixed true bit LLR values l^^'> and l^^^ in the {yr, Vi) plane for the 16-QAM at SNR=4.89 



